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Abstract 



C"~~ , The linear complementarity problem is to find vector z in IR" satisfying 

z'^{Mz + q) = 0, Mz + q ^ 0, z ^ 0, where M as a matrix and g as a vector, 
are given data; this problem becomes in present the subject of much important 
research because it arises in many areas and it includes important fields, we 
cite for example the linear and nonlinear programming, the convex quadratic 
programming and the variational inequalities problems, ... 

It is known that the linear complementarity problem is completely equivalent 
to solving nonlinear equation F{x) — with F is a function from IR" into itself 
defined by F{x) = (il/ + I)x + [M — I)\x\ + q. In this paper we propose a 

^^ ■ globally convergent hybrid algorithm for solving this equation; this method is 

H \ based on an algorithm given by Shi j22] , he uses vector divisions with the secant 

method; but for using this method we must have a function continuous with 
partial derivatives on an open set of IR"; so we built a sequence of functions 
F{p,x) S C'°° which converges uniformly to the function F(x)] and we show 
that finding the zero of the function F is completely equivalent to finding the 
zero of the sequence of the functions F{p,x). We close our paper with some 
numerical simulation examples to illustrate our theoretical results. 



Key words and phrases: Linear complementarity problem. Vector divi- 
sion. Global convergence, Newton's method, secant method . 
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1. Introduction: 

The complementarity problem noted {CP) is a classical problem of opti- 
mization theory of finding [z^w) £ IR" x IR" such that: 



(1) 



where /, a continuous operator from IR" into itself, is given data. 

The constraint < z, w >= is called the complementarity condition since 
for any i, 1 ^ i ^ n, z; = if Wi > 0, and vice versa; it may be the case 
that Zi = Wi — 0. 

In the case that the function / is a nonlinear continuous operator from 
IR" into itself, so the problem is called a NonLinear Complementarity 
Problem associated with the function / and noted (NLCP). 

In the case that the function / is affine, i.e 

fiz) = q + Mz, 

where q is an element of IR" and AI is a real square matrix of order n, so 
the problem is called a Linear Complementarity Problem associated with 
the matrix M and the vector q and noted {LCP). 

Solving the (LCP) in general, however, appears to be difficult. One simple 
reason is that there is no known good characterization of the nonexistence 
of a solution to the system for any given function /. 

The linear complementarity problem plays an important role in several 
fields (game theory, operational research ...); moreover, Cottle et Dantzig[T] 
et Lemke[T2] have proved that all problems of linear programming {LP), 
convex quadratic programming {CQP), and also the problems of Nash 
equilibrium of a game bi-matrix can be written as a linear complementar- 
ity problem. 

The question is precisely under what conditions on the matrix M and the 
vector q this problem admits one and only one solution, if this is the case, 
how can we express this solution as a function of the matrix and vector 
mentioned above. This question has not been completely resolved yet. 

However, many results already exist, for instance Lemke[T2] who gave 
sufficient conditions on the matrix Af and the vector q under which the 
number of solutions of LCP{M,q) is finite. Samelson [20], IngetonfTO]. 
Murtylin], Watson pS]. Kelly [IT] and Cottle [5] have by contrast shown 
that the matrix M is a P— matrix if and only if the linear complementarity 
problem associated with a matrix M and a vector q has a unique solution 
for all q G IR" (We should remind that a matrix M is called a P — matrix 
if all principal minors are strictly positive (see [7]), and we should note 
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that any symmetric and positive definite matrix is a P — matrix, but not 
vice- versa). 

2. Preliminaries: 

In this section, we summarize some notations which will be used in this 
paper. 

In particular, IR" denotes the space of real n— dimensional vectors, 

IR![; := {x G IR" : Xi ^ 0,i ^ l..n} is the nonnegative orthant and its 
interior is IR"+ := {x e IR" : Xi > 0,i^ l..n}. 

With X e IR" we define |a;| = (|a;i|, .., |a;„|)'^ G IR". 

We denote by / the identity matrix. 

Let x, y G IR", x"^y or < x,y > is the inner product of the x and y; \\x\\ 
is the Euclidean norm. 

For x G IR" and k a nonnegative integer, x^*^-* refers to the vector obtained 
after k iterations; for I ^ i ^ n, Xi refers to the i element of x, and xl 
refers to the z*'' element of the vector obtained after k iterations. 

Let X, y ^ IR", the expression x ^ y (respectively x < y) meaning that 
Xi ^ yi (respectively Xi < yi) for each i = l..n. 

For X G IR" we denote by e^ = (e^S .., e^")^ G IR" and for x G IR++ we 
denote by ln(x) — (In(xi), .., ln(a:„))"^. 

The transpose of a vector is denoted by super script T, such as the trans- 
pose of the vector x is given by x^. 

Remember that the spectrum a{A) of the matrix A is the set of its eigen- 
values and its spectral radius p is given by: p{A) :— sup{|A| such that 
A G (t{A)}. 

3. Equivalent reformulation of LCP: 

It is known in [T7] that the linear complementarity problem LCP{M,q) 
is completely equivalent to solving nonlinear equation 

F{x) = 

with F is a function from IR" into itself defined by 

F{x) := {M + I)x + [M - I)\x\ + q; 

More precisely (see [T7]), on the one hand, if x* is a zero of the function 

F, then 

z* := \x*\+x* , , 

w*:^\x*\-x* ^' 

define a solution of LCP{M, q). 
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On the other hand, if {z* , w*) is a solution of LCP{M, q), then 

z* — w* 



is a zero of the function F. 

We mention that this equation is solved by the fixed point algorithm (see 
[3T]), this algorithm is defined by: 

2;(o) £ ij^" arbitrary, , , 

^(fe+i) ^ (^i + M)-\I ~ M)\x^''')\ - {I + M)-hi ^^ 

For the case that M is symetric and positive definite, it was shown in [53] 
(see also Section 9.2 in [17]) that 

D= {I + M)-\l~M) 

it holds 



11^112 = ,Jp{D^D) = y/^m = p{D) < 1, 

where p{.) denotes the spectral radius of a matrix; hence ^ converges by 
the contraction-mapping theorem (see Theorem 5.1.3 in 1181) and 

X* = lim x'-''^ 

is the unique solution of the F{x) — 0. 

Therefore, 

w := \x \ — X 

and 

z* ;= |a;*| +x* 

define the unique solution of the LCP{M,q). 

We mention also that the convergence of algorithm ([3]) is only linear; in 
this paper, we consider the use of vector divisions with the secant method 
(see [22]) in instead of the algorithm ^ decribed above, this algorithm 
has global convergence (see [H]); but for using this algorithm we must 
have a function F a continuous with partial derivatives on a set of IR"; 
the next section can answer this problematic. 

Tlie main result 

We consider again the function F : IR" — ;> IR" defined by 

F{x) ~ {M + I)x + {M - I)\x\ + q 
and let's consider the sequence of functions F : IN*xIR" -^ IR" defined 

by 

F(j}, x) := (M + I)x + -{M- I) ln(e° + e^^ + e~P^) + q 
P 
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Proposition 1 ; F{j),x) converges uniformly to F{x) when p -^ +00. 

Proof. : To show that wc can start by 

- ln(e" + eP^ + e^^^) - \x\ = -[\n{e° + e^^" + e^P^") + In(e-Pl^l)] 
P P 



= iln[e-Pl="l * {1 + eP'-" + e-'P"")] 
P 

P 



then we have 



0^- ln(e° + eP'-" + 6"^=") - bU i ln(3) 
P P 

so 

iln(e° + eP^ + e-P=") 
P 

is uniform convergence to |a;| when p — > +00; 

Moreover, the operator (M — /) is linear then we have 

-{M-I)\n{e^+eP'^+e^P'^) converges uniformly to {M-I)\x\ as p ^ +00 
P 

and from the expression of the sequence of the functions F and the function 
F wc have 

F(p, x) converges uniformly to F(x) when p — > +00. 



Theorem 2 ; Let x* {p) be a solution of the equation F(p, x) = 0, then 
x*{p) is an approximation solution of F{x) — for p is large enough. 

Proof. :To show that, we use proposition(l) wich we can interpret as 
Ve > 0, 3 p* > such that for all p > p* we have 

\\Fix*ipm^\\Fix*ip))-Fip,x*ipm 
<e 

then we have for any e > 0, x*{p) is the approximation solution of 

F{x) ^ 0. 
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Remark 3 ; The uniqueness of the root of the function F results from the 
uniqueness of the solution of linear complementarity problem LCP{M, q), 
in fact, supposing that xl andx2, two distinct roots of the function F, exist, 
then 

* I * I ^ * 

^1 ' — l^^i I ' *^i • 

Since z^ ~ z| (uniqueness of the solution of LCP{M, q)) then 

\xl\ + xl = \x;\ + x;. (4) 

Simularly, we use the same method for wl and W2 we have 

Pi \ ~ •'^1 ~ 1-^2 I ~ ■^2- \^) 

SO — ISj) means that x^ = x^. 

Now, we give the following algorithm for solving F{p,x) — (see [H]): 
Algorithm: 

Step 0: Determine e, p, k* , p, a such that k* is a positive integer, 
< p < 1/2, and p < a <l; 

Step 1: Select two points x(°) and x^'^^ £ IR"; 

Step 2: for fc = 1, 2, ... until termination, do the following: 

1- Compute the steepset descent direction 

dW ■.^-J{p,x^''^fF{p,x^'''>), 
where 

F{p, x) ■- (M + I)x + -{M - I) ln(e° + e^^ + 6"^^) + q; 
P 

J{p, x) := (M + /) + {M - I)E{p, x) 

and 

Eji (p, x) :— 5ji ; 

I] v-f'j ; 1 + eP^» + e~P^' 

we racall that Sa — 1 and 5ij — Q ii i ^ j . 

2- if k equals a multiple of fc* , then insert a steepset descent direc- 
tion step, that is, let s'^^^ := d'^^^ and go to step 2.7; 

3- Compute: 

mW :=^iF(p,xW) 
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with 

IL^(fe) _.-^(fe-i)|l2 



and 

^ ||F(p,xW)-F(p,x('=^-i))||2 ■ 

4- if (uf*^) - 'y('^))^d('=) 7^ 0, then choose 



such that q;('^' maximizes the value of 

^""'^^ '"^ ^" ||sW||.|MW||' 

Set 

and go to step 2.7; 

5- if (uf*^) - vC'l)^ d'^''^ = and < v^^^\d^''^ » 0, then set 

' •" 2 

and go to step 2.7; 

6- if (uW - wC^))^^^ = and < v'^^\d^^^ >sC 0, then set s^ := 
d^*^) and go to step 2.7; 

7- take a line search along the direction s'^^^ to determine the step 
length 7 suth that 

/(p,xW +7sW) «; /(p,a;W) -7p < ^^,5^ > 

and 

< \/f{p,x^^^ +-is^^^),s''^^ >^ -cr < dW,s('^) >; 

where 

/(p,x)-i||F(p,x)||2 

8- set x'^^^^^ :— x^''^ + 7s('^) and go to next iteration. 

5. Numerical examples 

In this part, we consider some examples to test our method. The results 
of Fixed Point and using vector divisions methods for these examples 
are presented here for comparison purposes. The results and expected 
solutions for each example have been presented on the Tables 1 and 2. 
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Example 4 ; Consider the following linear complementarity problem: 
Find vector z in IR" satisfying z^ {Mz -\- (f) = {), Mz + g ^ 0, z ^ 0, 



where M 



4-100 
-14-10 
0-14-1 
0-14 



and q 



-4 

3 
-4 

2 



The exact solutions is x* = (1, 0, 1, 0)"^. 

We apply the fixed point and using vector divisions methods to solve this 
example with the initial approximation x^^> ~ (1.1,0.1, 1.2,0.2)^. 

The solution of this problem with six significant digits is presented in Ta- 
bid. 



Iteration 



z\ 



Z2 



z-i 



Zi 



k=01 



0,0000000 0,0000000 0,0000000 0,0000000 



k^05 



0,7883251 0,0000000 1,3448593 0,0000000 



k=10 



1,0197946 0,0000000 0,9884737 0,0000000 



Fixed 
point 
method 



k^l5 



0,9985643 0,0000000 1,0012907 0,0000000 



k^20 



1,0001030 0,0000000 0,9999377 0,0000000 



k=25 



0,9999918 0,0000000 1,0000058 0,0000000 



k=30 



1,0000005 0,0000000 0,9999997 0,0000000 



k:^33 



0,9999999 0,0000000 1,0000001 0,0000000 



k=34 



1,0000001 0,0000000 1,0000000 0,0000000 



k=35 



1,0000000 0,0000000 1,0000000 0,0000000 





Using vector 


k^Ol 


0,0000000 


0,0000000 


0,0000000 


0,0000000 


divisions 


k=02 


4,0000000 


0,0000000 


4,0000000 


0,0000000 


method 


k=03 


1,0000000 


0,0000000 


1,0000000 


0,0000000 



Table 1: The results of different methods for examplel. 

Example 5 .• Let's solve the following linear complementarity problem 
Find vector z in IR" satisfying z {Mz + q) = 0, Mz + q ^ 0, z ^ 0, 



where M = 



-1 



-1 



-1 6 



-1 7 



and q = 



1 

-2 
-3 



The exact solutions is x* — (0, 2! 7 29' ^) ■ 

We apply the fixed point and using vector divisions methods to solve this 
example with the initial approximation x^'^' = (—1, —2, —3, —4)"^. 

The solution of this problem with six significant digits is presented in Ta- 
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ble2. 



Fixed 
point 
method 



Iteration 



k=01 



k=05 



k=10 



k^l5 



k=20 



k=25 



k=30 



k^35 



k=40 



k^45 



k^50 



k=55 



k^60 



k=65 



k=70 



k=75 



k=79 



Zl 



Z2 



23 



Z4 



0,0000000 0,0000000 0,0000000 0,0000000 



0,1115059 0,6300237 0,3146258 0,0000000 



0,0000000 0,4906849 0,6581657 0,0000000 



0,0000000 0,5309163 0,5863067 0,0000000 



0,0000000 0,5192743 0,5936312 0,0000000 



0,0000000 0,5188339 0,5869623 0,0000000 



0,0000000 0,5173795 0,5862876 0,0000000 



0,0000000 0,5171712 0,5859293 0,0000000 



0,0000000 0,5171411 0,5860432 0,0000000 



0,0000000 0,5171911 0,5861363 0,0000000 



0,0000000 0,5172239 0,5861902 0,0000000 



0,0000000 0,5172388 0,5862079 0,0000000 



0,0000000 0,5172428 0,5862107 0,0000000 



0,0000000 0,5172428 0,5860930 0,0000000 



0,0000000 0,5172421 0,5862079 0,0000000 



0,0000000 0,5172416 0,5862071 0,0000000 



0,0000000 0,5172424 0,5862069 0,0000000 



k=01 



0,0000000 2,0000000 3,0000000 0,0000000 



k=02 



0,0000000 0,0000000 0,4367816 0,0000000 



Using vector 

divisions 

method 



k^03 



0,0000000 2,6264367 0,5000000 0,0000000 



k^04 



0,0000000 0,6983749 0,6163958 0,0000000 



k=05 



0,0000000 0,5172414 0,5862069 0,0000000 



k^06 



0,0000000 0,5172414 0,5862069 0,0000000 



Table 2: The results of different methods for example2. 

Conclusion: 

In this paper we have used that the linear complementarity problem is com- 
pletely equivalent to solving nonlinear equation F{x) — with i^ is a function 
from IR" into itself defined by F{x) = (M + T)x + (M - /)|a;| + q; for solving 
this equation we have used the Shi's method, this method uses vector divisions 
with the secant method; based on that, we have proposed a globally convergent 
hybrid algorithm for solving this equation; to do so, we had to build a sequence 
of functions F{p, x) G C°° which converges uniformly to the function F{x); and 
we have shown that finding the zero of the function F is completely equivalent 
to finding the zero of the sequence of the functions F. 
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